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Abstract 

We study certain self-interacting walks on the set of integers, that choose to jump 
to the right or to the left randomly but influenced by the number of times they have 
previously jumped along the edges in the finite neighbourhood of their current posi- 
tion (in the present paper, typically, we will discuss the case where one considers the 
neighbouring edges and the next-to- neighbouring edges). We survey a variety of possi- 
ble behaviours, including some where the walk is eventually confined to an interval of 
large length. We also focus on certain "asymmetric" drifts, where we prove that with 
positive probability, the walks behave deterministically on large scale and move like 
n I— 7- c^/n or like n i— t- clog n. 

Dedicated to Erwin Bolthausen on the occasion of his 65th birthday 

1 Introduction 

A locally self-interacting random walk on the set of integers is a sequence of integer-valued 
random variables {Xn,n > 0) with |X„_(_i — A„| = 1 for all n > 0, that can be defined 
inductively as follows: One initializes a "local time profile" by first choosing some function 
Lq that associates to each edge e of the lattice Z a real number Lo(e) (the set E of unoriented 
edges can be identified to the set Z + 1/2 or to the set of couples {x,x + 1} where x G Z) 
and one chooses the starting point Xq. The simplest choice is of course to set this initial 
function Lq to be equal to zero on all edges, and to start at the origin (i.e., Xq = 0) with 
probability one. 

The law of the walker is then described via some function R from to [0,1]. This 
function describes the probability of jumping to the right in terms of the local time profile 
"seen from the walker at its current position". More precisely, one defines inductively, for 
each n > 0, Xn+i to be equal to either A„ + 1 or A„ — 1 in such a way that 

P(A„+i = A„ + 1 I Ao, . . . , AO = R{{in{e), eeE)), 

where 

C(-) = LniX^ + ■) 
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is the local time profile seen from the particle at time n. At each step, one updates this local 
time profile as follows: e„+i = {X„,X„_|_i} denotes the edge of the (n + l)-th jump and 

Ln+l{e) = Ln{e) + l{e=e„+i} 

is the new local time profile. When Lq is identically zero, then L„(e) denotes the number 
of times the walk has jumped on the edge e before time n. This procedure clearly describes 
completely the law of the family > 0). 

Similar definitions work of course on other graphs than Z (for instance on U^). In the 
present paper, we will however restrict our discussion to the one-dimensional case. One can 
also use local times on sites instead of edges but the latter case turns out to be often easier 
to handle. 

Depending on the function the walker can be of self-repelling type (it prefers to go 
into the direction it has less visited in the past), self-attracting, or more complicated (it can 
be for instance repelled by the visits to the neighbouring edge, but attracted by its past 
visits to further edges). 

When the function R is "cylindric" i.e. when i?((£(e), e G -E)) is a function on the values 
£(ei), . . . , £(ex) for a finite set of edges ei, . . . , ck, the interaction can be described as "local" . 
In other words, for some constant K' , the past trajectory (Xq, Xi, . . . , X„) influences the 
outcome of X„+i — X„ only via the values of Ln{e) for the edges in the i^'-neighbourhood of 
X„. Note that in this cylindric case, if there is a large scale limit to the process (X„,n > 0) 
its evolution will be "purely" local as the finite-range becomes scaled down. 

Such locally self-interacting walks provide a particular class of random evolutions of func- 
tions as the sequence of functions {in{-))n>o form a Markov process. It is in fact very natural 
to study the evolutions where the function R is also height-invariant i.e. the particular case 
where 

i?((^(e), eeE)) = R{{1 + i{e), e G E)) 

for all and all real /. In other words, the walk is sensitive to the local discrete gradient of 
i but not to its actual height. This excludes for instance the family of "linear" reinforcements 
(see for instance |3] for a survey of these other types of reinforcements). Another way to 
view these evolutions is to define, for all x G Z and n > 0, the local gradient 

Vnix) = Vinix) := inix + 1/2) - 4(x - 1/2) 

and to say that R{{i)) is in fact a function R of [rj). 

In [6j, a case where R{{i)) was just a function of //(O) := — £(—1/2) was studied. 

Loosely speaking, this walk (sometimes referred to as true self-avoiding walk or true self- 
repelling walk - TSRW) is driven by the negative gradient of the local time at its actual 
position i.e., the walk prefers to go in the direction it has visited less often in the past. It 
turns out that a non-trivial scaling shows up, as X„/n^/^ converges in law to some non-trivial 
random variable. In fact, the entire limiting process can be described [S] (it is called the true 
self-repelling motion - TSRM). It corresponds to a random and local evolution of functions, 
that is neither a deterministic partial differential equation nor constructed via a white-noise 
driven stochastic partial differential equation. 

This raises the questions whether other such processes exist, whether the previous scaling 
limit is "stable" (do all similar discrete models have the same limiting behaviour? What 
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properties of the discrete model is actually captured by this scaling limit?), and provides a 
motivation to study self-interacting random walks associated to more general functions R. 

The family of models that we will focus on in the present paper are those where the 
self-interaction is governed by a linear combination of the values of the local time. In other 
words, we let 

eS-B 

where all but finitely many Oe's are zero, and we choose the local "drift" at step n according 
to the value of D {{[„))■ The fact that this evolution in height-invariant corresponds to the 
condition 

^a, = 0. 

Then, we take 

nm) = FiDim 

for some increasing function F such that F[—y) = 1 — F{y). In other words, if D is (very) 
positive (respectively, negative), then the walk will tend to jump to the right (respectively, 
to the left), so that D indeed plays the role of a local drift. A particularly natural choice for 
F turns out to be 

F{y) = . 

ey + e-^y 

In order to start investigating the variety of possible behaviours, one can for instance 
start to look at the case where R{i) is a function of (£(-3/2), £(-1/2), £(1/2), £(3/2)). A 
first natural choice is to pick two real numbers a and b, and to drive the walker by the linear 
combination 

D^'^ii)) = D"'^((£)) := a£(-3/2) + 6£(-l/2) - 6£(l/2) - a£(3/2). 

Note that these are the choices such that both height-invariance (because the sum of the 
terms a + b — b — a is zero) and left-right symmetry (the walks (X„) and {—Xn) have the 
same law because the coefficients in front of £(e) and £(— e) are opposite) hold. 

Note that when b is positive and a = 0, this is the previously mentioned TSRW with 
TSRM as scaling limit. When b > and \a\ is very small, one can therefore view this process 
as a perturbation of the TSRW. At the other end of the picture, when b is negative, it is 
easy to check that the walk will (with positive probability) eventually jump back and forth 
on one single edge (the more it jumps on it, the more it is attracted by it) which is not 
a particularly interesting case. In Section |2l we will describe various possible asymptotic 
behaviours, depending on the values of a and b. We shall see that intuition can sometimes 
be misleading; repellance by second neighbours does not always have the same effect as 
repellance by immediate neighbours as it can create traps. One interesting feature that we 
will mention is the existence (when 6 > > a) of a phase transition between stuck walks 
(that can eventually remain in a finite interval) and the non-stuck ones (with almost surely 
an infinite range), depending on whether —a > 6/3 or not. 

A second natural possibility is to break the left-right symmetry, and to drive the walker 
by a linear combination such as 

-£(-3/2) + £(-1/2) + £(1/2) - £(3/2) 
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which will be among those studied in Section [3] (with deterministic transient behaviour of 
the walker). 

Section [2] is more of survey- type presenting results proved in P, as well as heuristics and 
conjectures, while Section |3l will contain original results with actual proofs. 

Throughout the paper, we will mention results that hold with positive probability, like 
"with positive probability, the walk will eventually remain stuck on a single edge" . Clearly, 
one then implicitly conjectures that this is the generic behaviour of the walk (i.e. that the 
corresponding asymptotic event will hold almost surely), but in general, proving such almost 
sure results for self-interacting walks is not a straightforward task (and it requires different 
arguments), see for instance jl] for the linearly reinforced walk. We will not focus on these 
questions in the present paper. 

We would like to emphasize here that (despite the "phase diagram" that we will draw at 
the end of the next section) the aim of the present paper is not to give a full classification 
of the possible asymptotic behaviour of all these cylindric self-interacting walks. Our goal 
is rather to point out certain phenomenological features, in order to shed some light on 
how sensitive (or not) these walks are with respect to their microscopic definition, and what 
feature is kept in the scaling limit. 

A warm-up. As a warm-up to maybe help (if it does not help the reader, then she/he 
should not hesitate to skip this paragraph as it will not be essential later on) the following 
analysis, let us make some non-rigorous analogy with Fibonacci-type sequences and their 
related polynomials. Recall that our models are "driven" by a linear combination of the 
type 

fcl 

k=ko 

where a^^ 7^ 7^ a^^. If a walk is in some local equilibrium state (it does not "shoot in one 
direction" , it is somewhere in the middle of its past range, and the values of i are all very 
large), then one could expect that the value of D is rather small at most of the sites (at least 
compared to the total number of steps). After renormalization by the number of steps, this 
would indicate that 

fcl 

«fc+i/2^n(j + k + 1/2) « 4(1/2) 

k=ko 

i.e. that j Fj = £„(j-|-l/2)/£„(l/2) follows some Fibonacci-type progression. As we know, 
the behaviour of such progressions is controlled by the values (and position with respect to 
the unit circle) of the roots of the corresponding polynomial P{x) where 

P(x)x'=° = Yl ('k+l/2xK (1) 
k>ko 

The fact that the dynamics is height-invariant corresponds to the case where 1 is a root of 
P. Hence, it is in a way more appropriate to describe the self-interaction by its polynomial 
(in the case where the self-interaction is left-right symmetric, it does indeed characterize the 
self-interaction), and we will use this when we will illustrate some of our simulations. Note 
that the function 9 1— )> P(e'^), defined for 9 G [— vr, tt) is actually the Fourier transform of the 
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sequence (a^). Thus, the quahtative behaviour of the walk will depend on the type of the 
Fibonacci polynomial P{x), or, what is equivalent of the Fourier transform of the sequence 
of coefficients (afc). E.g., positive definiteness of this sequence plays an essential role. 

2 Survey of left-right symmetric cases 

During most of this section, the setup is the one described in the introduction, where the walk 
is "driven" by Z}"'^((£)), i.e. when we are considering the next-to-neighbouring interactions 
that are both height-invariant and left-right symmetric (we will comment on interactions 
with larger range at the end of the section). The meaning of a and b is as follows: 

• If 6 is positive (respectively, negative), then the walk is repelled (respectively, attracted) 
by its previous visits to the neighbouring edge. 

• a plays the same role as b but for the next-to-neigboring edges. 

• \a\ and \b\ describe the intensity of these self- interactions. 

As we shall see, in most of these cases, the qualitative asymptotic behaviour of the walk will 
depend on the signs of a and b, and on the ratio between \a\ and 

We can divide the parameter space into several classes. Let us first notice that in the case 
where 6 < 0, then with positive probability, the walk X„ will forever jump back and forth 
along one singe edge (between and 1, say). This is easily checked using the Borel-Cantelli 
lemma. Similarly, when 6 = and a is negative, then with positive probability, the walk will 
be stuck on a set of two edges (say, it will visit only the three sites 0, 1 and 2). These are 
the purely self- attractive cases. 

2.1 When 6 > and -6/3 < a < 6: The TRSM regime? 

Let us first very briefiy recall here the case where 6 > and a = 0: The walker is then driven 
by the negative gradient of the local time at its current position. As we have already men- 
tioned, this is the so-called true self-repelling walk This scaling limit was clarified 
in [B] and [8J; it is the true self-repelling motion (TRSM). 

It is quite natural to expect that this TSRW scaling behaviour is stable under perturba- 
tion, i.e. when choosing a ^ 0, but sufficiently small (in absolute value). There are some 
good reasons to guess that in the parameter range a G (—6/3,6) (and for 6 > 0), the long 
time asymptotic behaviour and scaling limit of the walk is similar to the TSRW case. Indeed, 
besides numerical evidence, one can note that: 

1. In this parameter range, we can identify a stationary and ergodic distribution of the 
"environment seen by the random walker" process. This distribution is qualitatively 
similar to the TSRW case, the difference being that instead of a product measure we 
get an exponentially mixing Gibbs measure. For details, see subsection 12.51 below. 

^In this terminology originating in the physics hterature, "true" refers to the fact that this is a true walk 
- the distributions of the first n steps is consistent with the distribution of the first n + 1 steps - and this 
is not always the case for measures on self-avoiding or self-repelling walks; the term "myopic" random walk 
has also been used. 
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Figure 1: TSRW trajectory: a = 0, b 



1, P{x) = {x-1). 



2. In this stationary and ergodic regime, using the variational method initiated in [2] and 
exploited in [5] for similar but continuous space-time models, one could very likely 
obtain superdiffusive lower bounds of the type E{X^) > Crc'l^ for the asymptotic 
variance of the displacement of the random walker. For details of similar computations 
in continuous space-time, see [5]. 

2.2 When 6 > and a < —6/3: The stuck case 

In this regime, the competition between the nearest edge self-repellence due to 6 > and 
next-to-nearest edge self- attractiveness due to a > is won by the latter because |a| is large 
enough, and the random walker is eventually trapped in an interval of finite length. The 
length of the trapping interval increases to infinity as the ratio \a\/b decreases to the critical 
value 1/3. More precisely, let us define for all positive integer k, 



This is an increasing sequence {Ai = 0, A2 = I, A4 = 2 and lim„_>.oo = 3). In pj, the 
following theorem is proved: 

Theorem 1 ([T]). Suppose that a < < b. 

• Ifb/\a\ G {Ak,Ak+i) for some k > 1, then with positive probability, the walk remains 
stuck on a set of k + 2 consecutive sites (and visits all these sites infinitely often). 

• Ifb/\a\ > Ak, then almost surely, the walk does not get stuck on a set with less than 



For instance, for some values of the parameter \a\ larger but very close to 6/3, the walk 
can remain stuck on a set of exactly 10^ sites. On the other hand, when < —a < 6/3, then 
the walk does almost surely not get stuck on a finite set. 

For proof of Theorem [T] and more refined details on the asymptotic behaviour of the walk 
in this particular trapping regime see pQ. 




k + 2 sites. 
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Figure 2: A walk (a = —1.1, b = 3) stuck on 11 sites: The trajectory and the local time 



2.3 When 6 > and a > b: The slow phase? 

In this regime, nearest and next-to-nearest edges are all repelling. Nevertheless these effects 
do not just always add up to produce a TSRM-type asymptotic behaviour. The second 
neighbours can produce traps that are difficult to get out from. 

In order to illustrate this, let us describe a scenario of building up traps, for the extreme 
case where 6 = and a > 0: The random walk starts by jumping back and forth on the 
edge Co between and 1 a large even number of times. This happens with probability 
= e~'^'^^ . Then, in some 0(1) number of steps it moves to site —4. (Note, that due to 
the large number of visits at edge eo the walker does not have a chance to return from site 
— 1.) Now, it performs yet again a number of + o{N) back and forth jumps on the edge 
e_4 (between sites —4 and —3). This happens with probability e~'^2{^+oW)_ After all this, 
in 0(1) number of steps the walker lands on edge e_2 (between sites —2 an —1). Now, due 
to the A^ -|- o{N) number of visits at edges eo and e_4 the walker does not have a chance to 
get away from edge e_2 before jumping e°''^^°^^^ times back and forth on this edge. 

Hence, we see that while it is very unlikely to build up a trap (and it therefore typically 
takes a long time to build up one), once it is built and if e"" is large enough, then it takes 
even much longer to escape from it. In fact, the previously described strategy to build such 
traps is certainly not the optimal one, and the probability to create one is in fact smaller, so 
that for all positive a, it takes much longer to escape from the trap than to create it. This 
slowing-down mechanism is reminiscent of that of random walks in random environment, 
and it indicates that there is no scaling limit process with continuous trajectories. 

2.4 The two critical cases 

When b is positive, we do not have precise results at this point for the two borderline cases 
where a = — 6/3 and a = b. 

• a = —6/3 is the borderline case between the conjectural TSRM regime (where the walk 
should scale like n^^^) and the sticky regime (when the walk is eventually stuck to a 
finite interval). We have seen that the walk does almost surely not stay in a finite 
interval, but its asymptotic behaviour is not really well understood. Naive scaling 
arguments (and the stationary measure computations mentioned at the very end of 
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Figure 3: The trapping phenomenon for a = 1 and 6 = 0: The trajectory and the local time 



the next section) would at first suggest that the non- degenerate scaling of the walk 
should be like n^/^. But it can be rigorously proved that in a stationary regime there 
exists a diffusive lower bound on the asymptotic variance of the displacement, and 
intuitively, one might guess diffusive behaviour (the stationary local time regime - see 
also Figure [2751 - and the walk displacement might have different scaling exponents and 
not interact in the large-scale limit). 




Figure 4: The "third derivative walk" i.e. P{x) = (1 — x)^: The trajectory 

• The case where a = b can be interpreted as the TSRW with self-repulsion defined in 
terms of occupation times on sites rather than edges. Its scaling behaviour is expected 
to be similar to the TSRW on edges (see [.Ij for references). 

Figure [5] sums up the rough phase diagram of the asymptotic behaviour of the walk 
depending on the values of (6, a) on the unit circle. 

2.5 Stationary measures for the cases where 6 > and —6/3 < a < b 

We now quickly survey some computations related to the existence of stationary measures 
for the current environment (i.e., the local time fiuctuations) as seen from the random walk 
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Figure 5: The phase diagram in terms of {b, a) on the unit circle 



in the conjectural "TSRM" regime. We will work in the more general context where the 
dynamics is driven by a height-invariant linear function of the local time i.e. where 

i?((£)) = e^/(e^ + e-^) 

with 

X 

where all but finitely many a{x)^s are zero. Wc will write R{{()) = p{ti). 
It is convenient to work with an initial profile r/o that belongs to the set 

Q = {ry : for all x, r){x) + 1^=0 G 2z}. 

It is immediate to check that this parity condition will be conserved for all n > (the 
opposite parity convention i.e. 77 + 1 e would also be preserved) so that {rjn, n > 0) is a 
Markov chain on Q. We can also restrict ourselves to the family of r^'s in Q, with finite norm 

II^IHE.6z2-i^'I^WI- 

We will use the following notation. If Xn+i — X„ = 1 i.e. X jumps to the right, we write 
r)n+i = 'R-rjn, and if it jumps to the left, we write rjn+i = ^Vn- In other words, for all x, 

TZr]{x) = r]{x + 1) + So{x) — Cr]{x) = r]{x - 1) - So{x) + S+i{x). 

The Markov chain is described by the fact that (given rjn) i]n+i is equal to TZrjn with 
conditional probability p{r)n), and that rjn+i — Cr]n otherwise. The transition operator of 
the Markov process is therefore 

Pf{v)=Piv)fiT^v) + (1 -p(r;))/(A)- 



9 



As often, it is convenient to view this Markov chain as the jump chain associated to a 

continuous-time Markov chain on the same state space. This continuous-time Markov chain 
{Vt,t > 0) jumps to the right with intensity dt x exp{D(7)t)} and to the left with intensity 
dt X exp{—D{fjt)}. 

The particular choice for the dynamics leads us naturally to look for a stationary distri- 
bution for fjt of "discrete Gaussian type" . We are going to suppose in the present section 
that: 

• (q;(-)) is even (i.e., a{x) — a{—x) for all x). This corresponds to the left-right symmetry 
mentioned in the Introduction. 

• The self- interaction has finite spatial range (i.e., all but finitely many Q;(a;)'s are equal 
to zero) 

• It is positive definite in the sense that for all {X{x),x e z) such that all of them but a 
finite positive number is equal to zero, 

J2 X{x)X{y)a{y - x) > (2) 

(this implies in particular that a{0) > 0). 

Note that in the case where D — D"-'^ and 6 > 0, this last condition precisely means that 
-6/3 <a<b. 

Under these assumptions there exists a unique Gibbs measure ttq on ft formally given by 



dno{r]) - exp{~'^r]{x)r){y)a{y - x)}. 



2 

x,y 

The proper, rigorous definition of the Gibbs measure ttq is in terms of conditional speci- 
fications on finite intervals, given fixed boundary conditions. This Gibbs measure is well 
understood, and its correlations decay exponentially fast with distance and the zero-one law 
holds for tail events. 

Proposition 2. Under the previous assumptions, the probability measure ttq is stationary 
and ergodic for the Markov process fit. 

The proof is straightforward and based on the following observation: 
= axp{-(„(l) - „(0)) - ^(a(x) - a(x - l)),(x)} = 

and similar formulae when one replaces TZ by C It proves that in fact the measure ttq is 
invariant under the process with "right-jumps" only, and under the process with "left-jumps" 
only. 

Ergodicity also follows from the above observation. The Dirichlet form 
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is easily computed. Using the above observation we get 

2V{f)= [ {p{r^){f{r^)-f{nv)y + {l-p{r^)){f{r^)-f{C7i)y)dM^)- 

Hence, since < p{r]) < 1 almost surely, it follows that T>{f) = if and only if almost surely 

/(7^r^) = /(r/) = f{Cv). 

But it is standard fact that the above almost sure identities hold if and only if / is tail 
measurable. Hence, by the zero-one law mentioned before, / is almost surely constant. This 
proves ergodicity. 

Also, one can note that the mean waiting time of the continuous-time Markov chain at 
T] is given by 

and that Z := 7ro(l/r) is finite. From this, it follows that one can define a probability 
measure it on Q hj 

cItt 1 
d^o^^^ ^ Z X T{r]) 

and that: 

Corollary 3. This probability measure n is stationary for the discrete chain {rjn)- 

Hence, we see that in this regime, and under these well-chosen starting distributions, the 
large-scale behaviour of the local-time profile is of Brownian-type. 

We can note that in the borderline case where 6 > and a = —6/3 (i.e. the discrete "third 
derivative" case), the previous stationary distribution analysis can be adapted to show that 
the discrete gradient of fjt (that is: the discrete second derivative of the local time profile) 
has a stationary measure of discrete Gaussian type. More precisely, we see in this interesting 
case that if we define for all e G -E, 

Vriie) = T]{e + 1/2) - r/(e - 1/2), 

then the process (Vfjtjt > 0) is a Markov process, and that it has a stationary distribution 
given by i.i.d. discrete Gaussians. 

For details of similar computations of stationary and ergodic measures of the environment 
seen by the moving particle, in continuous space-time setup, and their consequences see also 
0. 

2.6 Some comments 

To conclude this section, let us very quickly list a few observations: 

• In the setting of the TSRW, it was natural to describe the dynamics of the walker 
by saying that it was driven by an approximate negative gradient of the local time 
at its current position, and the dynamics of its scaling limit could also be described 
in this way. Our previous analysis however shows that this type of description has to 
be handled with care. The case {a = 1,6 = 0} seems at first to also correspond to a 
negative discrete gradient, but its large scale behaviour is completely different. 
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Figure 6: The third derivative walk: The (smoother) local time profile 



• In fact, in the general case, what seems more relevant to classify the asymptotic be- 
haviour of the walk is the quadratic form appearing in (|2]) or alternatively the study 
of the roots of P{x). This is also apparent in the study of the stuck walks in [1]. Note 
also that the borderline cases correspond to (multiples of) the polynomials (1 — x)^ and 
{1 — x)"^ {1 + x) . In the general case (with larger interaction-range), the phase diagram 
is seemingly more complicated, with different connected components of the parameter 
space corresponding to similar asymptotic behaviours. 

• A particular role is then played by the "odd" derivatives, i.e. more precisely, the 
polynomials (1 — x)^"+^. Then, the discrete n-th derivative of fj (and therefore of rj) 
has a stationary measure of discrete Gaussian type. 

3 Some cases without left-right- symmetry 

Let us stress that (as opposed to the cases studied in the previous section), the examples 
studied in the present section break the left-right symmetry i.e. the law of (X„,n > 0) and 
{—Xn,n > 0) are different even if one chooses Lq to be symmetric. 

3.1 Setup and statement 

In this section, we will first focus on the case where D = — A/2, where 

A((^(e), eeE))= £(-3/2) - £(-1/2) - £(1/2) + £(3/2). 

We then choose 

e-A/2 

which penalizes jumps in the direction of this second derivative. The precise form of the 
function R is not really important for what follows. For instance, our results clearly remain 
true if we only assume in addition of locality and height-invariance, that 

. R{{-i)) = l-R{{i)). 
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• R{{i)) is a function of A goes to very quickly as A — )• +00. 

These conditions can in fact also be relaxed. 

Note that A = 77(1) — ''7(— 1) is a discrete and symmetric version of the second derivative 
of the local time, but this feature is not essential in what follows. Intuitively speaking, the 
walk will tend to move to the right if the local time profile is locally concave and to the left 
if it is locally convex. 

The main result of the present section is the following: Suppose that the initial profile is 
identically zero (again, this is not really necessary - we only need this initial profile not to 
be too "wild"). Then: 



Proposition 4. With positive probability, Xn ~ v2n as n ^ 00. 



On large scale and on a positive fraction of the probability space, the walk becomes 
almost deterministic, but non-ballistic, and the scaling is of Brownian type. As we shall see, 
the proof gives in fact a more precise description of the behaviour of n > 0) on this 
event of positive probability. 
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Figure 7: The second derivative walk: The trajectory and the local time 



Let us immediately stress that the proof will in fact show that the results remain true if 
one replaces A by any function A of the type 

A((£(e), eeE))= £(-3/2) - £(-1/2) - £(1/2) + ^ aki{k). 

keE, k>3/2 

The facts that A is a local version of the second derivative, that it is translation-invariant 
and that it is "anti-symmetric" are therefore not so crucial after all. In fact, our conclusion 
holds true if we replace A by any local function A((£(e),e G E)) = J2eeE^e^i^) ^^^^ ^^^^ 

• For some cq < 0, = for all e < Cq- 

• (2-1/2 and ai/2 are both negative. 
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This for instance includes discrete p-th derivatives for "even" p's such as 

A((£)) = -£(-5/2) + 3£{-3/2) - 2£(-l/2) - 2£(l/2) + 3^(3/2) - £(5/2) 

that corresponds to a discrete forth derivative. 

In the "continuous hmit", the occupation time density profile of the motion t h-j- \/2t 
has a discontinuity at its local position (i.e. at time t, it is equal to xl^^^Q^^^y), and the 
size of this jump is growing with time. Hence, one could a priori naively expect that the 
walk would not slow down, but on the contrary speed up when this gap widens. This can be 
explained by the fact that the self-interacting random walk therefore captures some feature 
of the discrete local time profile that is not visible in the continuous limit. 

3.2 The scenario 

The coming three subsections are devoted to the proof of Proposition HJ Let us first describe 
in plain words a possible behaviour for our walk X (we shall then prove that indeed, this 
behaviour occurs with a positive probability): The walk X starts at the origin, jumps to its 
right i.e. Xi = 1, and it forever remains positive i.e. X„ > for all positive times. In fact, 
when n — )■ oo, X„ goes off to +oo. For each n > 0, denote S'„ = max{Xm, m < n) the past 
maximum of the walk. In our scenario, X„ > Sn — 2 for all n. In other words, for each n, 
either Xn is equal to its past maximum Sn, or it is equal to Sn — I or Sn — 2. 

We see that we can therefore decompose the set of times as follows: Define for each x > 
the hitting time of x by X, and let Ix = [tx+i,Tx+2)- Then, in our scenario, during each 
of the intervals I^, the walk jumps back and forth on the edges between x — 1 and x + 1. 
When it stops doing so, it first jumps to x + 2, and then jumps back and forth on the edges 
between x and x + 2 and so on. 

Imagine for a moment that this has happened for a while and that just before (for a 
large x) i.e. when n = — 1, the following loosely defined event G{x) is true: The walker 
has visited each of the edges {x — 2,x — 1}, {x — 3,x — 2} and {x — 4, x — 3} many times, and 
the number of times it has visited these three edges remain however comparable (in the sense 
that the difference between these three numbers of visits is small). In particular, immediately 
before it chooses to jump to x for the first time, the value of A((£„)) = £„(— 3/2) — £„(— 1/2) 
is rather close to zero (mind that at that moment X„ = x — 1, and that £„(l/2) = £„(3/2) = 
because the walk has not visited x yet) so that the probability to indeed jump from x — 1 
to X is therefore not too small. 

Then, the walk arrives at x for the first time. At that moment, the two edges to its 
right have not yet been visited, the edge between x and x — 1 (to its left) has been visited 
only once (because the walker arrives at x for the first time). On the other hand, the edge 
between x — 1 and x — 2 has been visited a lot of times. Hence, the walk will (very likely) 
jump back to x — 1. Once it is back at x — 1, the probability to jump to x or to x — 2 at that 
moment is neither very small nor very close to 1 (because the situation can not drastically 
change because of the two previous jumps). Note that if the walk then jumps to x — 2, the 
value of A will then be very small, so that the walk will want to jump immediately back 
to X — 1. Hence, the walk is (with high probability) trapped between x — 2 and x for a 
while. How long does this happen? Well, one should note that each time the walk jumps 
on {x — 2, X — 1} or on {x — 1, x}, it will increase the chance to jump to the right next time 
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it is at X — 1. Hence, after a short while, the walk will in fact only jump back and forth 
between x — 1 and x. This will be the case until the number of times at which it has jumped 
on {x — 1, ,x} starts to be comparable with the number of times at which it has jumped on 
{x — 2,x — 1}, because the walk will then have a significant chance to move to a; + 2. Hence, 
we end up in a situation where G{x + 1) holds. 




Figure 8: The local time profile in our scenario: Darker cells are constructed first. 

One important point in this scenario is that in the end, the walk will tend to jump a little 
more often on {x, x + 1} than on {x — 1, x}. So, by a law of large numbers type argument, 
the total number of visits of the edge {x — l,x} will turn out to grow "linearly" in x as 
X — >■ oo. This will a posteriori justify our assumption (in the definition of G{x)) that at the 
time Tx, the walk has visited {x — 2,x — 1} and {x — 3,x — 2} many times. 



3.3 Auxiliary sequences 

We now start to turn the previous ideas into a rigorous proof. Let us define a family of 
independent random variables (^Jfc), where j e Z/2, /c > 1, x e Z. For each j, k and x, the 
law of the random variable is the following: 

=+!) = !- = -1) = ^7T^- 

We can then define (deterministically) our random walk X using this family of random 
variables as follows. Let Xq — O and for each n > 0, choose inductively 

where n is the k-th time at which Xn = x and A„ = 26. Note that when X„ > 2, then A„ 
is necessarily even (because £„(— 3/2) and £„(— 1/2) are odd, while £^(1/2 and £„(3/2) are 
even). We will for the time being forget about this coupling between X and the ^'s, and just 
list a few simple observations concerning this family (Cj^k) of random variables. 

A particular role will be played by the random variables when x > 0, k = 1 and j is 
an integer. We denote them by (and drop the subscript k). Let us insist on the fact that 

are not defined for semi- integer j's (as opposed to the Cj.fe's)- Let us also keep in mind 
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that for a given k and when j is very large, the probabihty that ^J^. = — 1 and ^f.^ j. = +1 
is very close to 1. 

We now define certain events: 



• Let A denote the event that for all x, all j > ^/\x\/100 and all k < lOOx^, 

— —^^ — —1 



• Note that almost surely, for each x, the number of positive (respectively, negative) j's 
for which is positive (respectively, negative) is finite (it follows immediately from 
the definition that it has a finite expectation). B is the event that for all x > 0, 



• For all X > 0, let us define 

j>0 j<0 

There is no problem with the definition of for the same reason as above. Note that 
because of symmetry, E{M^) = P(Co = 1) = V^- The law of large numbers therefore 
ensures that almost surely 

y 

lim 7/-^ Vm^ = 1/2. 

x=0 

We define the event C, that for all ?/ > 1, ^^^^ e [y/i, 4y]. 
A simple application of the Borel-Cantelli Lemma enables to prove that: 
Lemma 5. With positive probability, An B nC holds. 
The proof is elementary and safely left to the reader. 



3.4 The coupling 

In order to simplify our notations, we will assume that at time zero, the initial profile is such 
that £o(— 1/2) = io{—3/2) ~ 1 and that £o is zero otherwise. Then, in our "good scenario", 
the A„'s will always remain even (because ^„(— 3/2) and ^„(— 1/2) are both odd, whereas 
£n(l/2) and £„(3/2) are both even). 

This assumption is not a problem. If we start with io being identically equal to 0, we let 
X move twice to the right, and at this time n = 2, the situation is exactly the previous one. 
Since we will prove asymptotic results about X with positive probability, our theorem will 
follow immediately from the results with this particular initial profile. 

Recall that our walk {Xn,n > 0) is defined deterministically from the Cj,k^ ^ follows: 
Xq = and for each n > 0, 
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where x — X^, j — A„/2 and k is the cardinal of the set 

{m < n : = x and = 2j}. 
Clearly, this definition ensures that one uses never the same ^Jj^. twice, and that indeed 

g-A„/2 

P(X„+1 = X„ + 1 I Xo, . . . , X„) = gA„/2 + e-A„/2 • 

Wc are going to assume that Ar\Br\C holds, and we will show that our "good scenario" 
holds as well. Note that there is nothing probabilistic in the following arguments. For this, 
we will inductively prove that for each x > 0, certain events E{x) hold. Define for each 
X > 1, the stopping time (Tj, = (t{x) as the first time at which the edge {x — 1, x} has been 
crossed more than x/8 times and the walk is at x — 1. We say that the event E{x) holds if 
the following four conditions hold: 

1. The walk did not visit x before a^- 

2. On [a^-i, CTj.], the walk did only visit the three sites x — 2,x — 1 and x. 

3. The last x/10 jumps of the walk before (Tx were all on the edge between x — 1 and x. 

4. At the time n — a^-, the two quantities 1/2) and ^„(— 3/2) differ by not more than 
V^, and they are both larger than x/6 and smaller than 50x. 



Position at time a{x) 



x-2 



x-\ 



Figure 9: The local time profile at a{x) 



Assume that Xx ^ 1, X2 = 2, and that £"(3), . . . , E{x) do hold (and that AnBtlC hold 
as well) . 
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For simplicity, let us first assume that are all equal to +1 when j < and to —1 when 
j > (we will then later see what difference it makes if for finitely many values of j this is 
not the case). Because E{x) holds, it implies that at the ca. x/10 first times at which the 
walk has been at x before time ax, the value of at those times was greater than x/20 
(because £„(— 1/2) was small, £„(— 3/2) was large and £„(l/2) = £„(3/2) = 0). Furthermore, 
the value of A„ at the time n = a{x) = a is very negative (recall that X„(^x) = x — 1, that 
at this time £o-(— 3/2) and £o-(— 1/2) are comparable, while £o-(l/2) is greater than x/8 and 
£„(3/2) = 0). Hence, our assumption on the ^j^^'s ensures that X^^i = x, X0-+2 = x — 1 
and X0-+3 = X (note that the k used in those steps can not exceed the number of times one 
visited the sites). After these two steps, the value of A„ (when the walk is at x — 1) has 
decreased by 2 i.e. A^^2 = Ag. — 2, whereas A^+a = A0-+1 — 2 if = Hence, we see 
that the walk will have to jump back and forth a number of times on the edge between x — 1 
and x; this will stop being the case because at some point, the walk will be at x and will 
meet a ^jj. that is equal to one. Because before that, the A's (at the visiting times of x) 
have been decreasing, we see that this can only happen when one uses a k = 1 i.e. when one 
uses ^0 = 1 (this is the C,j that is equal to one, for which j is the largest). 

From that moment (call it r) onwards, the walk will start jumping back and forth on 
the edge between x and x + 1 (this is because when it is at x, it will use ^J's for negative 
j's, and when it is at x + 1, it will use ^J^^ for very large values of j). This will happen 
until the time ax+i- At that time, £o-{a;+i)(— 1/2) = £o-(x)(— 1/2) i.e. the number of times at 
which the walk jumped on {x — l,x} is equal to the number of times the walk jumped on 
{x — 2,x — 1}, which ensures that in this very particular situation, E{x + 1) indeed holds. 

What is the difference due to those (^J's that are equal to —1 if j > or to +1 if j < 0? 
The first remark is that all these particular j's will indeed be used in our process (note that 
A is decreasing two by two at each visit of x, and that it starts from a very positive value 
and become very negative, and therefore has to use all ^J's for j G [— a/x, a/x]. Each time it 
meets a positive j such that = +1, it jumps to the right instead of jumping to the left. At 
the end of the day (i.e. at a{x + 1)) this will mean that ^(—1/2) will be diminished by two. 
Conversely, if it meets a non- negative j such that = —1, this will add 2 to the number of 
jumps on {x — l,x}. Hence, we see that in our "real" case, 

4(.+i)(-l/2) = 4(.)(-l/2) + 2M^ 

and that i^^(x + 1) will still hold because of our assumptions on the sum of the M^'s. 

As a consequence, we see that on the event An B n C of positive probability, all i?(x)'s 
hold. This implies in particular that for each x, the walk will not come back to the site x — 1 
after a{x + 1) i.e. that £o-(x+i)(— 1/2) is in fact the total number of times the walk does jump 
on the edge {x — 1, x}. 

Recall that E{M^) = 1/2 and that almost surely, X]z=o(^^^) ~ y as y — t- 00, so that on 
our event of positive probability, X]i=o^o"(^o(~V2) ~ 1/^/2. It follows that on our event of 
positive probability, a{x) ~ x^/2 so that n ~ (X„)^/2 (recall that between cr(x) and a{x + l) 
we know that Xn is equal to x — 1, x or x + 1) and X„ ~ \/2n as n — )• 00. 

This concludes the proof of Proposition |H 
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3.5 An example with logarithmic behaviour 

We now focus on an example that exhibits yet another possible asymptotic behaviour for 
the walk: D = —A* where 

A#((£(e), e G E)) = 2£(-3/2) - £(-1/2) - £(1/2) = -2r^(-l) - r^(0) 

and we then choose F as before. A naive first guess would be that this walk is self-attractive 
(it is "driven" by the positive gradient of its local time) and that it should get stuck. However: 

Proposition 6. With positive probability, X„ ~ (log n) /(log 2) as n ^ oo. 

350000 : 
300000 : 
250000 - 
200000 : 
150000 - 
100000 : 
50000 : 

200000 400000 600000 800000 l.xio' 

Figure 10: The logarithmic walk: The trajectory and the local time 





Again, the proof shows that this behaviour is valid for a wider class of self-interactions. 
In fact, it is quite similar to the case (with A) studied in the previous subsections. The 
main difference is that (in the "good" scenario that we will describe) the walk will visit 
approximatively twice more the edge e + 1 than the edge e for large e. Since the proof is 
otherwise almost identical to the previous case, we will only describe in plain words this 
"scenario" , and leave the details of the proof to the interested reader. 

Suppose that for some particular large time n^: 

• The walk is at its past maximum: Xn^ = maxm<„^ X^- We call this site x = X^^,, and 
for all n > 0, we define Un, Vn and Wn to be the respective values of i^n^+n at a; — 5/2, 
x-3/2 and X- 1/2. 

• The values of f/o, and Wq satisfy: 

f/o G [(9/10) X K)/2, (11/10) X ^/2] and G [K)/2, K)]. 

We also suppose that the value of Vq is very large. Note that under these assumptions, it 
very likely that = x — \ and Xn^+2 = x, i.e. that the walk will jump back and forth 

along the edge x — 1/2 between x and a; — 1, because —2Uo + Vq + Wq is very large, while 
— 2Vo + Wq is negative and has a large absolute value. A quick analysis shows that (with 
high probability) the walk will jump back and forth on this edge until the negative drift 
at X stops being huge, and the walk will then jump to a; + 1 for the first time. When this 
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happens, this means that at this time, 2V^ and Wn are comparable. Then, for some time, it 
will jump on the three sites x — 1, x and x + 1, but while doing so, the drift at x (i.e., that 
it feels when it is at x) grows fast, so that it will quickly be forced to jump along the edge 
between x and x + 1 only. We then let rix+i the first time n at which Ln{x + 1/2) is greater 
than Ln{x — 1/2) /2 and note that Ux+i satisfies the same conditions as thos we required for 
Tlx- Note also that once rix is found, the scenario is very likely to hold until n^+i when Vq is 
large (its conditional probability goes to 1 very quickly with as Vq gets larger). From this, it 
follows easily that with positive probability, the "good scenario" will indefinitely repeated. 
Then, clearly the total number of visits to the edge y+1/2 grows like 2^"'"°(^) as y ^ oo, and 
the proposition follows. 




Figure 11: The local time profile in the good scenario: Darker cells are constructed first. 



3.6 Ballistic behaviour 

To conclude, let us finally mention without proof a much less surprising possible asymptotic 
behaviour, namely the ballistic one. The following pictures correspond to the trajectory and 
local time for the case where D — — A** where 

A\{i{e), eeE))^ -^(3/2) - ^(-1/2) + 2^(1/2) = 2r?(l) + r?(0) 

that could seem at first glance to be again one of the walks driven (like TSRW) by the 
negative gradient of rj. This example, like many others in the present paper illustrates how 
sensitive the discrete model is to little shifts in the definition of the driving dynamics. 

4 Some open questions 

Let us conclude with a list of (possibly accessible) open problems related to the questions 
that we have just discussed: 

1. Prove the 2/3 scaling behaviour of the walk in the "TSRM regime" (i.e. where 6 > 
and a e {—b/3, h) and the stationary distribution makes sense), or even the convergence 
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to TSRM. Or construct anote related Markovian model (for instance with another 
function R) where one can prove this? 

2. Describe in some detail the "actual" (i.e., the one that actually dominates) trapping 
strategy in the "trapped case" 6 = and a = 1. 

3. Get some (even partial) description of the dynamics in the "slow phase." Does the 
qualitative behaviour depend only on 6/a? 

4. In the case where the walk goes deterministically to infinity, are other scaling be- 
haviours than ct, c\/t and clogt possible? 

5. Improve some of the results to almost sure statements (instead of "with positive prob- 
ability"). 

6. Is it possible that for some choice of the parameters in such self-interacting random 
walks with finite range, the qualitative asymptotic behaviour is actually not almost 
sure (i.e. can two different behaviours that exist with positive probability exist?). 

7. Do qualitatively really new asymptotic behaviours arise when one considers larger (but 
finite) self-interaction ranges? 



Other questions more directly related to the "stuck case" are listed in p]. 
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